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ABSTRACT 

This paper describes the MAIS and presents the BASIC 
programming code for the heuristic employed in this expert tutor 
management system, which is based on the findings of investigations 
of the direct connections among such learning environment factors as 
individual differences, cognitive learning theory, instructional 
technology, subject matter structure, and delivery systems. The 
following computer based variables which the expert system adapts to 
individual learner differences during the course of the instruction 
are presented as subroutines: (1) beta value computation; (2) mastery 
check and advisement; (3) learning time interval; and (4) format of 
examples and sequence. A figure depicts the instructional variables 
monitored by the MAIS expert tutor. (11 references) (EW) 
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Application of Heuristic Methods 
in the Design of Intelligent CAI 

Intelligent cxmjxiter^assisted instructional (ICAI) systems are 
characterized as holistic instructional infererx^making systems that are 
iterative in nature such that with experience, they can continuously improve 
the learning of each individual learner (Tennyson & Bark, 1987) . This 
inference-making process is done by an intelligent expert tutor system which 
actively seeks to improve learning by (a) initially prescribing instruction 
that has a high probability of preventing learner error arxVor Misconceptions, 
(b) that cxsntinucusly adapts the prescribed instruction according to moraent- 
to-monent assessment and diagnosis, and (c) generatively improves its decision- 
making system. Figure 1 illustrates the various instructional variables that 
the MAIS expert tutor management system adapts to individual learner 
differences and needs during instruction (Tennyson & Christensen, 1988) . Diese 
variables, termed computer-based enhancements, are managed by the expert tutor 
enplcying both formal and informal artificially intelligent (AI) heuristic 
programming methods (Dorner, 1983; TiWicmirov, 1983). 



Insert Figure 1 about here 



The MAIS 

The intelligent learning system presented in this paper, the MAIS, is 
based an the findings of an extensive programmatic research effort 
investigating the direct connections among such learning environment factors 
as individual differences, cognitive learning theory, instructional technology, 
subject matter structure, and delivery systems (especially computer-assisted 
instruction) . From the interaction of these factors, a MAIS-based ICAI 
program can be developed with reasonable success in reference to cost- 
effectiveness principles of isproved learning within standard production 
costs. Hiat is, unlike conventional ICAI demonstration (or pr o t o ty pe) 
programs that require costly dependence an powerful hardware and software 
systems (e.g. , a LISP machine) , a MAIS-based ICAI program can be developed 
within current mioxcccputer constraints of relatively limited memory. 

Heuristic Programming 

Bie purpose of this paper is to present the BASIC programming code for 
the heuristic enplcyed in the MAIS. We have tried to make the following code 
as generic as possible so that anyone with at least a working knowledge of 
BASIC or sane other language could easily design and program an ICAI. 
Remember that each of the variables of expert tutor is independent of the 
others, thus the selection of the individual variables is up to the designer. 
Hie only major dependent function needed to operate the MAIS expert tutor is 
the Bayesian conditional probability statistic. Die Bayesian function sets 
the parameters of the mastery learning quality control of the MAIS. That is, 
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Figure 1. Illustration of Instructional variables monitored by the MAIS expert tutor. 

e Tennyson & Associates 1986 
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the Bayesian provides the information on the decision of Whether to advance or 
retain the learner. 

Ihe statistical parameters in the Bayesian method allow the designer to 
determine the difficulty of the mastery learning decision. Hi our research we 
have established a standard format for the three parameters of the Bayesian 
statistic. Within this paper we will present only this standard format 
because it uses a heuristic that is very simple to program for use on a 
micxocatfxiter. Advanced users may want to deal directly with the formula that 
calcul at es individual beta value tables. Biis information is in Ttennyson, 
Christensen, and S. park (1984). 

Hie aanputer-based variables of the expert tutor are presented below as 
subroutines. Copies of an operating disk with sanple lesson are available by 
writing directly to the authors. 

Beta Value Ccannpaitation 

Ohe Bayesian subroutine returns a two digit beta value for calculations 
that are needed in computing amount of information, advisement, and display 
time interval (Tennyson et al., 1984) . The calculations in this standardized 
subroutine are an approximation of the inoccplete beta function. Die values 
from the incomplete beta function with a loss ratio of .3 (this figure is a 
statistical value in the Bayesian formula and ranges between values of .275 and 
.325, with the higher values resulting in increasingly conservative control 
over a false advance versus a false retain) , a mastery criterion level of .75 
(recal l that this figure must include learning error, thus it may seem lower 
than usual levels for post test mastery learning objectives) , and the number of 
interrogatory exanples at 14 (this number oculd be increased, but should not 
really be decreased to maintain pcwer of the statistic) is sent to a non- 
linear regression program that fits the best polynomial. The reason for the 
polynomial fit is to eliminate the need for calculating the beta value 
continuously throu^iout the program (this is certainly possible however an 
larger mini- and main-frame cxamputers) . 

BITOT The only input required is the number of examples correct and 

the number of examples presented, 
curror Two place beta value. 

Variable List and explanation: 

CORRECT Number of examples that were correct. 

PRESENT Number of examples that were presented. (Note: The code 

IKESENT A 2 / means to the second pcwer.) 

BETA Beta value. 

CO, CI, C2 Variables used in polynomial 

Code: 

100 CO - -.385747 + .0507146 * PRESENT - .00328486 * PRESENTS + 
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.0000935574 * PRESENTS 
200 CI + 1.37385 - .2958510 * PRESENT * .02450580 * PRESENTS - 

.0007305730 * PRESENTS 
300 C2 + -.273399 + .0767955 * PRESENT - .00725163 * PRESENTS + 

.00023077470 * PRESENTS 
400 BETA + CO + CI * CORRECT +C2 * CORRECTS 
500 BETA + INT [ABS(BETA * 100 + .5)] / 100 

Master/ Check and Advisement 

This subroutine uses the computed beta value to determine whether a given 
learner has m astered a given concept or rule (Tennyson & Buttrey, 1984) . The 
mastery decision is used by the expert tutor to make a decision on when to 
terminate instruction. For learner control situations, the expert tutor 
advises the learner of his/her progress and recommends an appropriate decision, 
but allows the learner to decide when to terminate (Johansen & Tennyson, 
1984) . This subroutine reports to the learner, after each example, his/her 
current level of mastery regardless of learner control or program control. 
Note that multiple concepts and rules (coordinate) .can also be used in this 
subroutine. In the following example code, the lesson has four concepts. 

INRJT Beta value 

Number of examples presented for each concept. 
CUTTOT Booleen stateirvent— mastered or not mastered concept (s) . BETA 

value PRINTED to advise learner of progress. 

Variable List and explanation: 

B ETA( Beta values from subroutine in array format 

MASTERED ( Array to determine concept mastered (1) or not (0) 

PRESENT ( Array for number of examples presented in each concept 

CONCEPT Number of concept 

MAST Accumulate mastery of all concepts 

EX Accumulate exhausted pool for concepts 

Code: 

XXL0 REM Reset EX and MAST to 0 
XX20 EX = 0: MAST = 0 
XX30 REM Mastery check 
XX40 FOR CONCEPT = 1 TO 4 

XX50 IF BETA(l) > 7 5 TH EN MASTERED(I) = 1: DONE = MAST = MAST + 1 
XX60 IF PRESENT (CONCEPT) > 13 THEN EXHAUST = EX = EX + 1 
XX70 NEXT CONCEPT 

XX80 REM Determine if all concepts mastered or example pools exhausted 
XX90 IF EX + MAST = 4 THEN (EXIT TO END OF PROGRAM) 
XL0O REM Print advisement 
XL10 FOR CONCEPT = 1 TO 4 

XL20 REM Format screen for your desired presentation 
X130 PRINT BETA (CONCEPT) 
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XL40 NEXT CONCEPT 
XL50 RETURN 



Learning Time Interval 



This subroutine monitors and updates the learning time of the 
interrogatory (practice) examples my increasing the amount of time for correct 
solutions (Tennyson & Park, 1984, 1985) . This MAIS enhancement monitors 
learning time for two purposes: (a) to provide immediate instructional help 
if the learner has not yet developed sufficient procedural knowledge; and (b) 
to prevent the learner from being forced into making an incorrect response 
(Tennyson, Park, & Christensen, 1985) . Monitoring the learning time is not a 
only a means to improve effectiveness of the instruction, but also to maintain 
efficiency of the learning environment. That is, time available for learning 
is a finite variable controlled by both external factors (e.g. , school time 
periods, time of the day, excess to appropriate facilities, etc.) and internal 
factors (e.g., fatigue, attention, effort, etc.). 

Because the parameters of this subroutine include statistical values 
concerning (a) difficulty of the concept, (b) difficulty of each example, and 
(c) update in learning progress, it is necessary to establish these values 
before using the learning time subroutine. In practice, we initially estimate 
these values and then collect actual times to precisely set the values. (A 
detailed discussion of these parameters is given in Tennyson, 0. Park, & 
Christensen, 1984) . 



INPUT Beta Value 

Example to presented next 

Example Difficulty Index (EDI) (mean time for 

experts to answer problem correctly) 
Concept Standard (statistical mean time of EDIs) 
Concept Difficulty Index (CDI) (statistical 

variance of EDIs) 
Lapsed time on example 
OUTPUT learning time 

Concept Difficulty Index (value added to increase 

learning time) 

Variable List and explanation: 

IAPSE Total elapsed time 

LOCAL Local current example's learning time 

CDI( Array for concept difficulty index 

BETA Beta value 

EDI( Array for concept difficulty index 

RESPONSE Last response 0 = Incorrect; 1 = Correct; 2 = Time elapsed 

CONCEPT Current concept being presented 

STANDARD ( Array of concept standard 

EXAMPLE ( The specific example to be presented next 
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Code: 

XX10 REM Check learning time against elapsed time 

XX20 IF LAPSE > LOCAL THEN RESPONSE = 2 

XX30 REM Concept difficulty index subroutine 

XX40 CDI (CONCEPT) = CDI (CONCEPT) + BETA * STANDARD (CONCEPT) 

XX50 REM Learning tame subroutine 

XX60 LOCAL = EDI (EXAMPLE) + CDI (CONCEPT) 

For example, if the total set of examples for a given concept has a mean 
value of 17 sec. (STANDARD) , and a variance of 2.5 sec. (CDI) , and a current 
beta value of .55, the calculation for the concept difficulty index would be 
the following: 

CDI (Concept) = 2.5 + .55 * 17 
CDI (Concept) = 11.85 

For the next example (if current example correctly answered and an EDI value 
of 15 sec.) , the learning time value would be increased as follows: 

LOCAL = 15 + 11.85 
LOCAL = 26.85 

This heuristic allows for an iterative learning time increase with each 
succeeding correct response. 

Formal of Examples and Sequence 

This subroutine selects the format of the next example according to the 
response given to the current example, as follows: if correct or if time 
elapses, the next example will be in an interrogatory format; if incorrect, it 
will be presented as an expository example (Park & Tennyson, 1986) . Also, 
this subroutine selects the sequence of the next example according to, first, 
the generalization rule (usually for the first four interrogatory examples) 
and, second, the discrimination rule (usually starting with the fifth example 
(Park & Tennyson, 1980) . This subroutine also determines that no example is 
presented more than once and that no example is presented if the example pool 
is exhausted. 

INPUT Last response 

Concept presented and selected 

Number of examples for each concept presented 

OJTPUT Sequence of next concept and format of example 

Variable List and explanation: 

RESPONSE Last response, 0 = Incorrect; 1 = Correct; 2 = Time elapsed 

ANSWER Last concept selected 

EXAMPLE Number of example selected 

SEQUENCE 0 » Generalization; 1 = Discrimination 
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MASTERED ( Array to determine concept mastered (.1) or not (0) 
FRE SENT ( Array for number of examples presented in each concept 
CONCEPT Number of concept 

XXLO REM Select example number from pool 
XX20 EXAMPLE = INT(RND(1) * 14 + 1 

XX30 REM First four examples presented in each concept are generalization 

XX40 IF SEQUENCE = 1 AND PRESENT (CONCEPT) < 5 THEN SEQUENCE = 0 

XX50 IF SEQUENCE ■ 1 AND PRESENT (CONCEPT) > 4 THEN SEQUENCE = 1 

XX60 REM When response is incorrect or time elapsed and generalization is in 

effect then concept to be selected remains the same 
XX70 IF RESPONSE = 0 OR (RESPONSE = 2 AND SEQUENCE - 0) THEN GOTO XL20 
XX80 REM If response is incorrect and discrimination then next concept to be 

selected is the learner's incorrect response 
XX90 IF RESPONSE = 0 THEN CONCEPT = ANSWER: GOTO XL20 
XL00 CONCEPT = INT(RND(1) * 4 + 1) 

XL10 REM Determine example pool exhausted / If exhausted then response must be 

changed to correct so random select of concept occurs 
XL20 IF PRESENT (CONCEPT) > 13 THEN RESPONSE = 1: GOTO XXLO 
XL30 REM If response is correct and concept not mastered then start over 
XL40 IF RESPONSE = 1 AND MASTERED (CONCEPT) = 0 THEN GOTO XX10 
XL50 REM If example was used before start over 
XL60 IF SELECTED (CONCEPT, EXAMPLE) = 1 THEN GOTO XX10 
XL70 SELECTED (CONCEPT /EXAMPLE) = 1 
XL80 RETURN 

The variables of corrective error analysis and pmhedded refreshment and 
remediation are task-specific enhancements that are designed at the point of 
individual lesson development. The important concept for the former variable 
is to consider the type of analysis as a function of the instructional 
strategy to be employed. For the latter variable, the design decision comes 
from the structure of the content to be learned. Both of these variables need 
attention so as to provide adequate instructional help, but not to the point 
of r educing efficiency of the learner. For example, too much interference 
from adjunct instruction can distract the learner and consequently use up 
valuable learning time. 

Summary 

Our purpose in this paper was to present the program code of the 
heuristics employed in the MAIS. The MAIS program is supported by both 
learning theory and instructional theory. Also, the instructional variables 
and conditions of the MAIS are supported b u empirical verification; tested in 
a well-defined program of research, and evaluated by disciplined peer review. 
The value of the theory-based instructional design system supported by direct 
research findings is that it can be generalized to specific learning needs and 
conditions. And, for implementation purposes, the MAIS is r eadily transferable 
to most currently available hardware and software. And, as computer technology 
itself improves, it will be possible to both enhance the present variables and 
conditions yet to be discovered. Some of these new variable will come from 
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research in such diverse areas as individual differences, human-inachiiie 
interface design, neuropsychology, psychametrics, canpiter software, 
perception, and the continuing significant research arri theory development in 
the field of instructional technology, curricular management as veil as 
hardware and software developments. 
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